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Wlat  should  you  buy?  From  whom?  Eicb  time  questions 
like  these  are  decided,  the  decisioD-ma.klDg  effort  should  be- 
come a  pjece  o{  history  that  others  can  beneRt  from  liter  on. 
Yet  decisions  of  esscDtiiUy  the  same  kind  are  made  over  and 
over  ajsd  the  pa/tjapants  in  the  decision  making  go  over  the 
same  tedious  ground  already  plowed  by  thousands  of  others. 

la  this  chapter,  Lee  shows  that  what  we  need  is  a  lan- 
guage for  describing  bow  decisions  are  made  in  terms  that 
maJce  goals  and  arguments  explicit.  With  such  a  language, 
all  sorts  o/ questions  can  be  answered  that  traditional  deci- 
sion science  can  deal  with  only  obliquely.  To  what  extent, 
for  example,  can  a  past  decision  serve  as  a  precedent  for  a 
current  decision?  Eow  would  a  particular  decision  turn  out 
if  cost  were  not  important?  What  would  person  X  decide  to 
do?  What  are  the  risks  involved  in  choice  Y?  VVTiat  wouJd 
be  tie  effect  of  product  Z,  il  announced? 

Thus  Lee's  language  makea  a  new  Jcind  of  wbat-if  ex- 
ercise possible  for  decision  makers.  Importantly,  Lee's  lan- 
guage also  makes  what-bappened  exercises  vastly  easier  too. 
Just  keeping  track  of  what  happened  in  big  government 
system-integration  contracts,  so  as  to  provide  an  audit  trail 
later  on.  can  consume  half  of  the  total  cost.  Were  decisions 
made  in  the  way  envisioned  by  Lee,  the  audit  trail  would  be 
a  byproduct  of  decision  making,  not  an  add-on  activity. 
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In  this  chapter,  we  describe  a  Qualitative  Decision  Management  System, 
called  SIBYL.'  The  goal  of  a  Qualitative  Decision  Management  System  is 
to  help  users  represent  and  manage  the  qualitative  aspects  of  the  decision 
making  process — such  as  the  alternatives  being  considered,  the  goals  to  sat- 
isfy, and  the  arguments  evaluating  alternatives  with  respect  to  the  goals. 
For  this  purpose,  SIBYL  provides  a  language  for  representing  decision  mak- 
ing processes  and  also  provides  a  set  of  services  that  help  to  manage  the 
dependencies  represented  in  the  language. 

We  proceed  as  follows.  We  first  present  a  scenario  that  illustrates  the 
kinds  of  services  that  a  qualitative  decision  management  system  should  pro- 
vide. In  the  remainder  of  the  chapter,  we  describe  how  SIBYL  provides  these 
services.  First  we  describe  the  Decision  Representation  Language  (DRL) 
that  SIBYL  uses  to  represent  the  qualitative  aspects  of  decision  making 
processes.  In  the  section,  "An  Example."  we  show  an  example  decision 
graph — that  is,  the  representation  in  DRL  of  a  particular  decision  making 
process.  In  the  section,  "Services."  we  discuss  the  major  types  of  services 
that  we  have  identified — the  management  of  dependency,  plausibility,  view- 
points, and  precedents.  We  illustrate  these  services  with  the  example  in  the 
section,  "An  Example."  In  the  section,  "Related  Work,"  we  discuss  how 
our  approach  is  related  to  similar  attempts  to  support  qualitative  decision 
making.  Finally,  we  conclude  with  topics  for  future  research. 


A  sibyl  WIS  one  of  a  number  of  prophetesses  in   Greek  mythology  who  gave 
wise  counsel  by  mediating  with  the  Gods  on  behalf  of  human  supplicants. 


106  Jintae  Lee 

Scenario 

Imagine  you  are  trying  to  decide  which  knowledge  representation  language 
to  use  for  your  project  called  ZEUS.  You  ask  your  project  members  to  use  a 
qualitative  decision  management  system  to  enter  thoughts  relevant  to  this 
decision.  These  include  all  the  alternatives  that  should  be  considered,  the 
constraints  an  ideal  alternative  should  satisfy,  the  relevant  facts  and  claims 
for  e\'aJuating  the  alternatives,  and  the  dependencies  that  hold  among  these 
claims.  The  system  provides  a  language  and  a  user-interface  for  using  the 
language,  such  as  object  editors,  menus,  and  graphic  displays.  Also,  the 
system  is  distributed  so  that  users  can  examine  what  has  already  been 
entered  and  then  can  enter  additional  opinions  incrementally.  Suppose 
users  have  given  their  initial  inputs;  the  following  scenario  illustrates  a 
session  with  a  hypothetical  qualitative  decision  management  system.  Here, 
it  assumes  natural  language  input  for  the  purpose  of  exposition,  but  the 
LQierface  can  be  graphical  and  mouse-based,  as  it  is  implemented  in  SIBYL. 

User:     Show  me  the  current  status. 

System:      The  system  displays  the  decision  matrix  shown  in  fig- 
ure 1. 


Suius  at  Ui«  D«^lon:  Find  an  OpUmil  Knowlrdgc  RepresmtjUon  Ljitguigc  far  Zna 


\mporlM»t« 


snoBE 

KCE 

LOOPS 


Stppon  Z^nRrqalrrarau         MhlnluCao  CaaoalubiNly 

H.  H  L 


H  H  H- 

H-  L  M 

H  i^fvtohrmd  H 


Figure  1.  An  overall  evaluation  of  the  alternatives  for  the  decision  problem  of 
finding  aji  optimal  knowledge  representation  language  for  ZEUS. 

In  the  figure,  each  row  represents  an  ahemative,  each  column  rep- 
resents a  desirable  property  or  a  goal,  and  each  cell  represents  the 
evaluation  of  the  ahemative  with  respect  to  the  goal.  Although 
the  evaluation  ts  shown  jn  terms  of  H  (high),  M  (medium),  and  L 
(low),  the  evaluation  measure  can  be  numerical  or  defined  by  the 
user.  An  evaluation  measure  marked  uith  a  '*  '  means  that  there 
ts  some  qualification  on  the  measure. 

User:  What  is  the  qualification  on  the  evaluation  of  STROBE 
with  respect  to  customizability? 
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System:  The  evaluation  of  STROBE  is  'H-'  with  respect  to  Cus- 
tomizability, provided  that  we  can  get  the  source  code. 

When  this  qualifying  assumption  turns  out  to  be  wrong,  the  sys- 
tem updates  all  the  objects  thai  depended  on  this  assumption  and 
reevaluates  the  alternatives. 

User:  Why  is  LOOPS'  evaluation  unresolved  with  respect  to 
Minimize  Cost? 

System:  The  following  questions  need  to  be  answered  for  eval- 
uation. 

Ql       Which  hardware  platform  should  be  used  for 
the  project? 

Q2      Would  ENVOS  give  us  a  free  copy  of  LOOPS? 

User:     What  are  the  possible  answers  to  Ql? 

System:  Sun,  Symbolics,  or  Dandetiger.  By  the  way,  there  is  a 
decision  record  associated  with  this  question.  See  Decision  Prob- 
lem, Hardware  Platform,  if  you  want  to  look  at  it. 

User:  What  are  the  current  overall  evaluations  for  the  hardware 
alternatives? 

The  system  retrieves  the  decision  record  associated  with  this  ques- 
tion and  shows  the  overall  evaluation  of  the  attematives. 

System:         Sun  (very  good) 

Symbolics  (very  good) 
Dandetiger  (poor) 

This  overall  evaluation  is  computed  by  merging  the  evaluation 
measures,  like  the  ones  shown  m  figure  1,  but  for  this  hardware 
decision  problem,  properly  weighted  by  the  importance  of  the  dif- 
ferent goals.  The  system  can  use  a  default  merging  procedure  or 
one  that  the  user  specifies.  The  user  can  note  examine  how  the 
evaluation  was  arrived  at  by  asking  the  system  to  display  the  de- 
cision matrices  for  this  hardware  platform  decision.  Bui,  instead, 
she  goes  back  to  the  current  decision  problem,  and  wants  to  make 
an  assumption  to  see  its  consequences. 

User:     Assume  that  we  use  Symbolics.  How  would  it  affect  the 

evaluations? 

System:         STROBE  (very  good) 
KEE  (good) 

LOOPS  is  not  an  alternative  any  more  because  it 
is  incompatible  with  the  hardware  choice. 

LOOPS  does  not  run  on  Symbolics.  This  dependency  information 
has  been  entered  earlier,  so  the  system  knows  thai  LOOPS  should 
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no  longer  be  an  altemaitve.  Other  arguments  thai  depend  on  this 
new  knowledge  get  updated  and  the  alternatives  are  reevaluated. 

User:  Tell  me  how  you  arrived  at  the  evaluation  of  STROBE  with 
respect  to  Minimize  Cost? 

System:  The  system  displays  the  matnz  shown  in  figure  2.  The 
matni  shown  is  like  the  maim  in  figure  1  except  that  the  columns 
now  show  the  subgoals  of  the  goal,  Mmtmtie  Cost. 


Status  of  Ihf  Sub(;oals  of:  tht  Goal;  Minimiu  Cos* 

Coals 
Importi  net 
Atl«mativc9 

Minimiu  Dfvdopmcnl  Cwt             C«t  On  t  Qi  caper 
M                                              L 

STROBE 

KEE 

LOOPS 

H-                                             H 
H-                                          L 
M                                           H 

Figure  2.  Evaluation  of  the  aJternatives  with  respect  to  the  subgoals  of  the  goal, 
Minimize  Cost. 


User:  Tell  me  how  you  arrived  at  the  evaluation  of  STROBE  with 
respect  to  Minimize  Development  Cost? 

System:  The  system  displays  the  the  argument  graph  in  figure  3. 
The  argument  graph  shows  the  arguments  evaluating  STROBE  with 
rtsptci  to  the  goal  of  Minimizing  Development  Cost. 

User:  Suppose  we  do  not  consider  the  goal,  Minimize  Cost.  How 
would  that  change  the  evaluation? 

System:         KEE  (very  good) 
STROBE  (good) 

Tlie  user  can  ask  to  see  the  matrix  responsible  for  these  evaluations 
but,  instead,  the  user  wants  to  freeze  the  current  state  so  that  she 
can  come  back  to  it  later  or  compare  it  to  other  states  that  have 
also  been  frozen. 

User:  Create  a  viewpoint  with  the  current  assumptions  and  call 
it  "Not  Considering  Development  Cost." 

System:  The  current  assumptions  that  have  been  introduced 
since  last  time  are: 
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Figure  3.    Axguments  evaluating  STROBE  with  respect  to  the  goal,  Minimize 
Development  Cost. 

1  We  use  Symbolics  as  the  hardware. 

2  "Get  One  Cheaper"  is  no  longer  a  goal.  Do  you  still  want  to 
create  the  viewpoint? 

User:     Yes 

System:  The  viewpoint,  "Not  Considering  Development  Cost" 
has  been  saved. 

Having  created  a  viewpoint,  the  user  can  add  further  arguments 
under  thts  viewpoint.  Alternatively,  she  could  switch  to  another 
viewpoint,  and  add  arguments  in  that  viewpoint. 

The  user  would  like  to  know  if  there  have  been  any  decisions  m 
the  past  that  would  be  worth  ezamining. 

User:     Retrieve  useful  past  decisions. 

System:  The  following  are  the  past  decisions  that  might  be  rel- 
evant in  the  order  of  similarity  to  the  current  decision  problem. 

Choose  an  optimal  knowledge  representation  language 
for  the  project  XANADU.  (Decision  140) 
Choose  a  programming  language  for  the  project,  ZEUS. 
(Decision  245) 

Choose  an  operating  system  for  the  project,  ZEUS.  (De- 
cision 247) 

After  the  user  examines  these  past  decisions,  she  decides  to  trans- 
fer some  of  the  relevant  knowledge  from  these  earlier  decisions. 


110 


Jintae  Lee 


User:     Show  me  the  relevant  information  from  DP  140. 

System:  The  system  displays  the  folder  shown  in  figvrt  4.  The 
folder  contains  all  the  altimattves,  the  desirable  properties,  and 
the  arguments  that  the  system  judged  to  be  relevant.  The  user 
examines  each  of  these  objects  in  more  detail  and  selects  those 
that  she  judges  to  be  relevant. 

User:  Transfer  all  the  objects  that  I  selected  to  the  current  de- 
cision problem. 

System:     Done 

User:  Show  me  the  current  overall  evaluation  of  the  alternatives 
with  the  new  knowledge. 

System:         STROBE  (very  good) 
NEXPERT  (very  good) 
KEE  (good) 
KNOWLEDGE  CRAFT  (unresolved) 

The  user  explores  these  alternatives  and  examines  relevant  argu- 
ments «n  the  ways  descrxbed.  She  then  goes  on  to  add  further 
issues  and  arguments,  saves  them,  and  calls  tt  a  day. 


lci**w«l  Kf*e«lM]|«  rrnm  Ihc  l>«TttaN*   Ckocsiat  K«*»kdn  Rc^tMautM*  L^lmi  (w  Xksiris 


Q^iliTn 


Figure  4.  Knowledge  judged  relevant  from  a  past  decision. 


The  above  scenario  illustrates  the  features  desirable  for  a  quahtative  de- 
cision management  system.  The  rest  of  the  chapter  shows  how  they  are 
realized  in  SIBYL,  our  implemented  system. 
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Decision  Representation  Language  (DRL) 

The  services  of  SIBYL,  revolve  around  decision  graphs — the  records  of  the 
pros  and  cons  evaluating  alternatives  with  respect  to  the  goals.  In  this  sec- 
tion, we  brieBy  describe  the  language  used  for  constructing  these  decision 
graphs,  which  we  call  the  Decision  Representation  Language. 

Figure  5  shows  the  objects  and  relations  that  form  the  vocabulary  of 
DRL.  Figure  6  presents  them  graphically.  The  fundamental  objects  of  DRL 
are  Alternatives,  Coeds,  and  Claims.  Other  objects  in  DRL  are  no  less 
essential  in  decision  making,  but  they  are  either  special  cases  of  the  above 
three,  or  they  are  objects  useful  beyond  the  context  of  decision  making,  as 
we  discuss  below. 


Alternative 
Goal 

Decision  Problem 
Claim 

DRL  Relation 

Is-A-Sub-Decision-Of    (Dec.    Prob.  ,   Dec.    Prob.) 

Is-A-Subgoal-Ol    (Goal,    Goal) 

Facilitates    (Alternative,    Goal) 

Is-An-Alternative-For    (Alternative,    Dec.    Prob.) 

Supports   (Claim,    Claim) 

Denies   (Claim,    Claia) 

Quedifies    (Claia,    Claim) 

Queries    (Question,   Claim) 

Influences   (Question,    Claim) 

Are-Arguments-For   (Group  of   Claims,    Claim) 

Is-An-AnsBering-Procedure-For   (Procedure,   Question) 

Is-A-Result-01    (Claim,   Procedure) 

Ansoers    (Claim,    Question) 

Are-Possible-Answers-To   (Group  of   Claims,    Question) 

Is-A-Sub-Procedure-Ol   (Procedure,   Procedure) 

Is-A-Kind-01    (Object,    Object) 
Question 
Procedure 

Procedure  Description 
Executable  Procedure 
Group 
Viewpoint 

Figure  5.  The  DRL  Vocabulary. 
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isi-nib-decijion^ 


■re-pouiblc-mzwen-io 


qualiflei 

I  chum 


sipporu       \ 


Group 

7TX 

it-k-manber-of 


I  cluml 


(-•D-auwerinf -procedure-far 


CUun 


Qum 


Oum 


it-k-cub-procobue-of 


is-«-rcnh-of 


Figure  6.  The  DRL  Model. 


Alternatives  represent  the  options  to  choose  from.  Goals  specify  the 
properties  that  an  ideal  option  should  have.  A  Goal  Gl  may  be  related 
to  another  Goal  G2  through  an  Is-A-Subgoal-Of  relation,  meaning  that 
satisfying  Gl  facilitates  satisfying  G2.  A  special  subtype  of  Goail  is  De- 
cision Problem,  representing  the  topmost  goal  of  the  form  "Choose  X 
optimal  for  Y."  Hence,  cili  the  goals  are  subgoals  of  the  decision  problem 
because  they  elaborate  ways  of  satisfying  this  top  level  goal.  A  Decision 
Problem  DPI  is  related  to  another  Decision  Problem  DP2  through  an 
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I8-A-Sub-D«ci8ion-Of  relation  if  DP2  requires  solving  DPI.  For  exam- 
ple, choosing  the  best  computer  environment  for  one's  project  has  among 
its  subdeclsions  choosing  the  hardware,  choosing  the  operating  system,  and 
choosing  the  programming  language.  When  this  is  the  case,  the  altetUA- 
tives  of  the  parent  decision  consist  of  combinations  of  the  alternatives  from 
its  subdecisions. 

Claims  are  used  to  represent  arguments  relevant  for  choosing  among  the 
alternatives,  DRL  makes  no  distinction  between  facts  and  claims.  Any 
statement  is  defensible,  that  is,  it  can  be  denied  in  DRL.  A  Clai«  can 
be  related  to  another  Claia  through  Supports,  D«niat,  or  Qualifiet 
relations.  A  Claim  CI  Supports  another  Claim  C2  if  the  plausibihly  of  C2 
becomes  higher  (or  lower)  when  that  of  CI  goes  up  (or  down).  A  Claim 
Cl  Denies  another  Claim  C2  if  the  plausibility  of  C2  becomes  lower  (or 
higher)  when  that  of  Cl  goes  up  (or  down).  Exactly  how  the  plausibilities 
get  updated  is  discussed  in  the  section,  "Plausibility  Management."  A 
Claim  Cl  Qualifies  another  Claia  C2  if  the  plausibiUty  of  C2  becomes 
null  when  that  of  Cl  becomes  low  enough.  As  long  as  the  plausibility  of  Cl 
remains  high,  it  has  no  effect  on  the  plausibihty  of  C2.  All  DRL  relations 
are  subtypes  of  Claim.  For  example.  Supports  (Cl,C2)  is  itself  a  claim 
that  the  claim  Cl  supports  the  claim  C2.  Hence,  the  relation  itself  can  be 
supported,  denied,  or  qualified — for  example,  when  a  person  agrees  with 
Cl  and  C2  but  does  not  agree  that  Cl  supports  C2.  The  Is-A-Kind-01 
relation  is  a  claim  aisserting  a  specialization  relation  between  two  objects. 
For  example,  Is-i-Kind-Ol  (Al,  A2)  holds  when  Al  is  the  alternative  "Use 
Sun"  and  A2  is  the  alternative  "Use  Sun  4."  All  the  claims  that  influence 
the  plausibiUty  of  a  claim  can  be  grouped  and  related  to  it  through  an 
Are-Arguaents-For  relation. 

Facilitates  (A,  G)  is  the  Claim  that  the  alternative  A  facilitates  satisfy- 
ing the  goal  G.  The  plausibility  of  this  Facilitates  claim  is  the  measure 
of  how  satisfactory  the  alternative  is  with  respect  to  the  goal  in  question. 
Is-An-Altemative-For  (A,  DP)  is  the  claim  that  the  alternative  A  rep- 
resents an  option  for  solving  the  decision  problem,  DP,  that  is,  that  A 
facilitates  satisfying  the  top  level  goal  represented  by  D.  Hence,  the  Is- 
An-Altemative-For  relation  is  a  subtype  of  the  Facilitates  relation. 
A  Question  represents  an  uncertain  state  which  requires  more  information 
to  determine  its  outcome  uniquely.  There  are  two  kinds  of  Questions. 
A  Question  might  be  a  simple  request  for  an  explanation — for  example. 
Why  do  we  need  an  email  interface?  Alternatively,  it  may  represent  a  major 
uncertainty  whose  different  potential  outcomes  might  lejuJ  the  decision  in 
different  ways.  The  first  kind  of  Question  can  be  linked  to  any  object 
through  a  Queries  relation.  The  second  kind  of  Question  is  linked  to 
a  claim  through  an  Influences  relation.  A  Question  Q  Influences  a 
Claim  C  if  the  plausibility  of  C  depends  on  the  answer  to  Q.  A  Claim 
C  Answers  a  Question  Q  if  C  represents  a  possible  answer  to  Q.  AU  the 
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possible  answers  to  a  Question  can  be  grouped  and  related  to  the  Question 
through  an  Are-Posaible-lnsBers-To  relation. 

A  Procedure  represents  either  an  actual  executable  procedure  (Exe- 
cutable Procedure)  or  a  textual  description  of  a  procedure  (Procedure 
Description).  A  Procedure  object  can  be  related  to  a  Question  through 
an  Is-ln-Answering-Procedure-For  if  it  is  believed  that  the  procedure 
can  be  used  to  answer  the  Question.  A  Claia  C  Is-A-Result-Of  a  Pro- 
cedure P  if  C  is  the  information  obtained  as  a  result  of  executing  P.  A 
Procedure  may  be  related  to  other  Procedures  through  an  Is-A-Sub- 
Procedure-01  or  an  Is-A-kind-ol  relation.  The  Is-A-Sob-Procedure- 
Of  relation  describes  the  part/whole  relationship  among  procedures,  and  it 
is  used  when  one  wants  to  describe  a  procedure  in  terms  of  the  component 
procedures  that  implement  it.  For  example,  "Get  Simulation  Software"  is 
a  sub-procedure  of  "Run  Simulation."  The  Is-A-Kind-01  relation  men- 
tioned above  can  be  used  to  specify  the  specialization  relationship  among 
procedures.  For  example,  "Run  System  Dynamics  Simulation"  Is-A-Kind- 
Of  "Run  Simulation." 

A  Group  represents  a  set  of  objects  of  the  same  type,  among  which 
we  want  to  indicate  some  relationship.  A  Group  object  has  the  following 
attributes:  Members  and  Member-Relationship.  The  Members  attribute 
points  to  all  the  objects  that  belong  to  the  group.  The  Member  Relation- 
ship attribute  takes  as  values  such  relationships  as  Conjunctive,  Disjunc- 
tive, Mutually  Exclusive,  and  Exhaustive.  A  Viewpoint  is  an  object  that 
represents  a  collection  of  objects  sharing  a  given  constraint.  For  example, 
all  the  alternatives,  goals,  and  the  claims  that  were  created  under  the  as- 
sumption that  the  hardware  platform  is  Symbolics  form  a  viewpoint.  As 
such,  a  Viewpoint  is  a  generalized  Group,  where  the  members  are  not  just 
a  set  of  objects  of  one  type,  but  objects  of  different  types  related  to  one 
another  through  various  relations.  Viewpoints  are  discussed  in  more  detail 
in  the  section,  "\^iewpoint  Management." 

An  Example 

Figure  7  shows  an  example  decision  graph  constructed  using  DRL.  This 
graph  is  a  small  portion  of  the  decision  graph  constructed  in  the  course 
of  an  actual  decision  process  using  SIBYL,  slightly  modified  for  the  pur- 
pose of  presentation.  SIBYL  has  been  implemented  in  Object  Lens  [Lai  et 
al.  1989],  which  is  a  general  tool  for  computer  supported  cooperative  work 
and  information  management  that  provides  many  of  the  features  needed 
for  SIBYL.  These  include  a  friendly  user  interface,  a  knowledge  base  inter- 
face, hypertext  capability,  and  an  email  interface.  SIBYL  has  been  actually 
used  in  several  decision  making  processes — such  as  choosing  an  optimal 
computer  environment  for  different  projects,  and  cooperatively  designing  a 
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Figure  7.  Aji  example  dedsion  graph. 
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floor  space.  The  example  in  this  section  will  be  used  later  to  illustrate  the 
services  that  SIBYL  provides. 

The  decision  problem  is  that  of  choosing  an  optimal  knowledge  rep- 
resentation language  for  implementing  the  system  called  ZEUS.  Three  al- 
ternatives (LOOPS,  STROBE,  and  KEE)  are  considered,  although  all  the 
arguments  concernbg  KEE  have  been  omitted.  The  desirable  properties 
of  the  knowledge  representation  language  are  represented  as  goals.  The 
arguments  evaluating  the  alternatives  are  represented  &s  claims  about  the 
Facilitates  relations  between  the  alternative  and  the  relevant  goals.  For 
example,  the  claim  that  the  present  version  already  runs  in  LOOPS  is  an  ar- 
gument in  favor  of  the  claim  that  the  alternative  LOOPS  facihtates  satisfying 
the  goal  of  minimizing  development  time,  represented  by  the  Facilitates 
relation  between  them.  Hence,  the  plausibility  of  the  Facilitates  rela^ 
tion  represents  the  evaluation  measure  of  LOOPS  with  respect  to  the  goal 
in  question. 

As  noted  above,  all  the  relations  in  DRL  are  claims.  Hence,  they 
can  be  supported,  denied,  or  qualified.  For  example,  if  one  accepts  the 
claim,  "STROBE  comes  with  IMPULSE,  which  provides  much  of  the  interface 
functionalities"  but  one  does  not  agree  that  this  claim  supports  the  claim 
that  "STROBE  facilitates  minimizing  development  time,"  then  one  denies 
the  Supports  relation  between  the  claim  and  the  Facilitates  relation  in 
question  (see  figure  7). 

It  is  important  to  emphasize  that  the  decision  graph  is  only  a  graph- 
ical rendering  of  the  knowledge  base,  and  that  the  user  does  not  see  it  in 
the  form  presented  in  figure  7.  The  system  selectively  displays  portions 
of  the  decision  graph  or  relevant  attributes  of  selective  objects  in  different 
formats  (for  example,  a  table,  a  graph,  or  a  matrix)  appropriate  to  differ- 
ent contexts.  It  also  provides  a  template-based  editor  for  easily  creating 
and  linking  objects.  Hence,  the  implemented  user  interface  is  much  more 
friendly,  but  it  is  not  the  topic  of  this  chapter. 

To  reduce  the  complexity,  figure  7  omits  the  group  objects  that  convey 
the  information  about  the  relations  among  a  set  of  claims  or  goab;  an 
example  of  a  group  is  shown  in  figure  8. 

Services 

Dependency  Management 

Dependency  Management  is  responsible  for  maintaining  a  consistent  state 
of  the  knowledge  base  when  a  change  is  introduced.  In  decision  making, 
objects  or  their  attribute  values  depend  on  others.  For  example,  in  figure  7, 
the  fact  that  LOOPS  is  an  alternative  depends  on  which  hardware  is  chosen 
for  implementing  ZEUS.  If  Symbolics  is  the  chosen  hardware,  LOOPS  is  no 
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longer  an  alternative  because  it  does  not  run  on  Symbolics.  We  should  be 
able  to  represent  such  dependency  as  well  as  representing  what  should  be 
done  when  we  acquire  the  information. 

Figure  8a  shows  how  such  a  dependency  is  represented  in  DRL.  Any 
uncertainty  involved  in  a  dependency  is  represented  as  a  Question.  Hence, 
we  create  a  Question  object,  "Which  hardware  is  chosen  for  implementing 
ZEUS,"  and  Unk  it  to  the  Is-An-Altemative-For  relation  through  an 
Influences  relation.  The  possible  outcomes  of  the  Question  are  claims  of 
the  form,  We  use  X,  which  are  bnked  to  the  Question  through  the  Answers 
relation.  Alternatively,  if  we  wanted  to  specify  a  relationship  among  these 
outcomes  (for  example,  disjunctive  or  mutual  exclusive  relations),  we  would 
group  these  claims  via  a  Group  object  as  shown  in  figure  8b. 
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Figure  8.  A  representation  of  dependency  in  DRL. 
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Each  of  these  claims  has  an  attribute  called  UpdateProcedure,  which  pro- 
vides the  following  information:  a  predicate  on  the  plausibility  of  the  claim, 
and  the  action  to  perform  when  the  predicate  is  true.  The  predicate  can 
be,  for  example,  (>  30)  if  the  plausibihty  measure  used  is  numerical,  or 
(>  Very-High)  if  the  measure  is  categorical.  The  system  provides  a  set 
of  standard  plausibihty  meeisures  and  the  appropriate  predicates,  but  the 
user  is  free  to  invent  her  own.  A  typical  action  that  one  can  specify  is  that 
of  updating  the  plausibility  of  the  influenced  claim.  Thus,  we  can  spec- 
ify the  following  pair,  ((>  Very-High),  Set-Plausibility(O))  as  the  value  of 
the  UpdateProcedure  attribute  of  the  claim,  "We  use  Symbohcs"  so  that 
when  Symbohcs  becomes  the  most  likely  hardware  of  choice,  LOOPS  would 
no  longer  be  considered  as  an  alternative.  Figure  9  shows  the  updated  de- 
cision graph.  The  alternative,  LOOPS,  and  the  relevant  claims,  do  not  get 
deleted,  however;  they  only  become  invisible  and  have  no  effect  on  the  deci- 
sion. They  become  visible  again  if  their  importance  or  plausibility  becomes 
non-zero.  Other  kinds  of  eictions  that  can  be  performed  include  creating 
new  objects  and  linking  them  to  existing  objects  via  specified  relations. 
We  plan  to  provide  a  high  level  language  for  specifying  such  actions.  With 
such  a  language,  the  action  can  be  an  arbitrary  procedure  written  in  the 
language. 

Other  relations  among  claims,  such  as  Qualifies,  Supports,  Denies, 
are  special  caises  of  Influences,  and  represent  more  speciaUzed  kinds  of 
dependency.  The  action  of  a  Quadif  ies  relation  is  to  set  the  plausibihty 
of  the  qualified  claim  to  zero  when  the  plausibility  of  the  qualifying  claim 
becomes  low.  That  is,  the  UpdateProcedure  of  the  quahfied  claim  is  of  the 
form,  ((<  Threshold),  Set-Plausibility(O)),  where  the  value  of  Threshold 
is  set  either  globally  or  locally.  Above  the  threshold,  the  qualifying  claim 
has  no  effect  on  the  plausibility  of  the  claim  qualified.  For  example,  in 
figure  10,  the  claim,  "Can  get  the  source  code"  had  no  effect  on  the  claim 
it  qualifies.  However,  when  it  is  denied  by  the  claim,  "The  source  code  is  no 
longer  available"  and  if  its  plausibihty  becomes  low  enough,  the  plausibility 
of  the  claim  it  qualifies,  "We  can  modify  the  source  code,"  is  set  to  zero.  A 
consequence  is  that  this  change  propagates  so  as  to  make  the  evaluation  of 
STROBE  with  respect  to  the  goal  of  Minimize  Development  Cost  less  strong. 
The  action  of  a  Supports  relation  is  to  raise  (or  lower)  the  plausibility  of 
the  supported  claim  when  the  plausibility  of  the  supporting  claim  goes 
up  (or  down).  The  action  of  a  Denies  relation  is  to  lower  (or  raise)  the 
plausibihty  of  the  denied  claim  when  the  plausibility  of  the  denying  claim 
goes  up  (or  down). 

Plausibility  Management 

Plausibility  Management  is  a  special  case  of  Dependency  Management.  It  is 
responsible  for  maintaining  consistency  among  the  plausibilities  of  related 
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at  each  step.  One  is  the  plausibility  values  of  the  component  claims  that 
are  being  merged.  In  the  case  of  Dempster-Shafer,  each  piece  of  evidence  (a 
claim  C)  needs  to  supply  an  information  pair,  (Beiief(C),  Plausibility(C)). 
In  one  version  of  the  Bayesiaji  procedure  [Duda  ei  at.  1979],  each  claim 
needs  to  supply  Pr(C),  and  each  relational  claim  that  links  two  cleiims, 
CI  and  C2,  needs  to  supply  a  pair  (Pr(C2|Cl),  Pr(C2|-^l)).  The  pa- 
rameters that  the  chosen  procedure  needs  as  input  is  to  be  found  in  the 
Plausibility  attribute  of  the  claims  involved.  Thus,  if  the  user  is  supplying 
her  own  procedure,  then  she  needs  to  ensure  that  the  Plausibility  attribute 
of  claims  supply  appropriate  arguments  for  the  procedure.  The  other  kind 
of  information  that  a  procedure  needs  is  how  the  component  claims  axe 
related — for  example,  whether  they  are  independent,  mutually  exclusive, 
and/or  conjunctive.  As  discussed  above,  this  knowledge  is  contained  in 
the  Member  Relationship  attribute  of  the  group  object  which  groups  the 
claims  related  to  a  given  claim. 

Once  we  compute  the  plausibility  of  all  the  Facilitates  relations 
between  STROBE  and  all  of  the  goals,  we  need  to  propagate  them  across 
the  la-A-Subgoal-Ol  relations  and  merge  them  properly  to  produce  the 
overall  evaluation  of  STROBE.  Given  that  G2  and  G3  are  subgoals  of  GI, 
that  we  have  the  evaluation  measures  of  STROBE  with  respect  to  G2  and  G3, 
and  that  we  have  the  importance  measures  for  G2  and  G3,  how  should  they 
be  reflected  Ln  the  evaluation  of  STROBE  with  respect  to  Gl?  For  example, 
what  is  the  evaluation  of  STROBE  with  respect  to  "Minimize  Cost"  when 
we  have  computed  its  evaluations  with  respect  to  the  subgoals,  "Get  One 
Cheaper"  and  "Minimize  Development  Cost"? 

The  ainswer  to  the  above  question  requires  a  careful  analysis  of  the 
relations  that  can  hold  among  goals.  The  Is-A-Subgoal-01  relation  is 
not  sufficient  to  capture  these  relations.  For  example,  subgoals  can  be 
independent  or  have  tradeoffs;  they  may  exhaust  their  parent  goal;  or  they 
can  be  mutually  exclusive  or  overlapping.  Also,  subgoals  may  interact  in 
various  ways,  as  planning  research  has  discovered  [Sussman  1975;  Sacerdoti 
1977;  Chapman  1985].  How  the  evaluation  measures  propagate  and  merge 
across  the  goals  will  depend  on  the  kinds  of  relations  that  hold  among 
them.  We  are  still  working  out  the  taxonomy  of  these  relations,  based  on 
Quinlan's  work  [1983].  Depending  on  what  kind  of  relation  holds  anxjng 
the  subgoals,  we  may  be  able  to  use  a  simple  algorithm  such  as  the  weighted 
average  of  the  plausibilities  by  the  importance.  Again,  rather  than  being 
committed  to  a  particular  algorithm  we  provide  an  interface  for  a  merging 
procedure  so  that  the  user  has  control  over  how  the  merging  should  be 
done. 

Another  issue  that  we  have  not  yet  resolved  satisfactorily  is  how  to 
represent  and  reflect  the  degree  of  consensus.  If  more  users  agree  with 
a  claim,  the  plausibility  of  that  claim  should  go  up.  On  the  other  hand, 
the  mere  number  of  users  should  not  be  an  indication  of  the  plausibility 
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because,  for  instance,  users  might  not  endorse  a  claim  even  when  they  agree 
with  it,  judging  it  to  be  obvious.  Hence,  the  number  of  users  who  happen 
to  endorse  a  claim  explicitly  is  somewhat  accidental.  In  the  present  version 
of  SIBYL,  when  a  user  makes  a  claim,  she  is  associated  with  the  claim  as  its 
creator.  Then,  if  users  want  to  express  approval  of  the  claim,  they  do  so  by 
associating  themselves  with  the  claim  as  its  co-creators.  This  scheme  allows 
the  decision  maker  to  assign  plausibility  to  the  claim  by  considering  not  only 
the  number  but  also  other  factors  such  as  the  credibiUty  and  the  expertise 
of  the  users  associated  with  the  claim.  We  are  not  completely  satisfied  with 
this  scheme,  and  we  would  hke  to  find  one  that  places  less  burden  on  the 
decision  maker.  We  plan  to  find  a  better  measure  of  consensus  by  studying 
other  work,  for  example,  Lowe  [1986]. 

Viewpoint  Memagement 

Viewpoint  Management  is  responsible  for  creating,  storing,  retrieving,  map- 
ping, and  merging  Viewpoints.  A  Viewpoint  is  an  object  that  represents  a 
collection  of  objects  that  share  certain  assumptions.  Multiple  Viewpoints 
on  a  decision  record  represent  multiple  perspectives  on  the  given  decision 
problem.  Figure  10  shows  a  viewpoint  which  evaluates  alternatives  with- 
out considering  a  particular  goal.  The  importance  of  the  goal  of  getting  a 
cheaper  language  (and  its  subgoals  if  there  were  any)  has  been  set  to  null 
so  that  it  no  longer  shows;  nor  do  the  the  claims  that  were  relevant  to  these 
goals. 

There  are  at  least  five  types  of  cases  where  we  want  to  create  multiple 
Viewpoints  in  SIBYL.  We  need  viewpoints  with: 

•  Different  assignments  of  importance  to  goals. 

•  Different  assignments  of  plausibilities  to  claims. 

•  Different  subset  of  objects  such  as  goals  and  alternatives. 

•  Different,  hypothetical,  answers  to  a  question. 

•  Objects  at  different  time  points. 

The  first  two  cases  are  obvious.  They  are  needed  when  we  want  to  see 
what  happens  if  we  place  different  weights  on  goals  or  claims.  A  typical 
example  of  the  third  case  is  found  when  one  wants  to  consider  only  goals  or 
claims  whose  importance  or  plausibihty  measure  is  beyond  certain  thresh- 
old. Another  example,  mentioned  earlier,  is  the  one  where  all  the  goals 
of  minimizing  cost  have  been  deactivated.  In  the  fourth  ceise,  a  viewpoint 
corresponds  to  a  state  in  a  truth-maintenance  system.  When  faced  with  un- 
certainty, one  makes  different  assumptions  and  pursues  their  consequences 
from  different  viewpoints.  In  the  fifth  case,  Viewpoints  provide  a  version 
mechanism.  One  should  be  able  to  freeze  the  states  into  viewpoints  at  dif- 
ferent times  so  that  one  can  see  the  way  that  the  decision  making  unfolded 
at  a  later  time,  or  even  revert  back  to  a  previous  viewpoint  if  necessary. 
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Figure  10.  A  viewpoint  not  considering  the  go»l,  "Get  One  Cheaper. 
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Viewpoints  are  first-class  objects  in  DRL.  As  such,  they  can  appear 
as  alternatives  in  a  meta-decision  problem  such  as  whether  we  should  stop 
exploring  additional  alternatives.  Also,  Viewpoints  can  be  related  to  one 
another  in  more  ways  than  chronologically.  The  following  relations  have 
not  yet  made  their  way  into  DRL,  but  they  will  in  the  future:  I8-A-I«xt- 
Version-Of ,  Elaborates,  Restricts,  Has-Dillerent-Importaace,  Has- 
Dillerent-Plansibilities. 

It  is  also  important  to  be  able  to  establish  mappings  between  objects 
in  different  viewpoints.  Such  mappings  would  show  how  the  problem  rep- 
resentation has  evolved  in  the  course  of  a  decision  making  process.  For 
example,  a  claim  may  differentiate  into  more  specific  claims;  or  several  al- 
ternatives may  be  merged  into  one  if  their  differences  prove  unimportant 
for  a  given  purpose.  We  would  represent  this  evolution  as  mapping  be- 
tween viewpoints  representing  different  time  slices.  It  is  also  useful  to  be 
able  to  merge  viewpoints.  For  example,  if  the  marketing  group  and  the  de- 
sign group  were  both  evaluating  alternatives  for  a  computer  environment, 
it  is  natural  that  they  make  their  evaluations  within  their  own  viewpoints 
and  then  later  merge  these  viewpoints  for  an  overall  evaluation.  We  are 
still  working  out  this  aspect  of  Viewpoint  Management.  Relevant  litera^ 
ture  includes;  studies  on  view  and  schema  integrations  in  database  research 
[Battini  ei  al.  1986;  Lee  k  Malone  1988],  work  on  versions  [Katz  et  ai  1984; 
Goldstein  k.  Bobrow  1981;  Bobrow  ei  al.  1987],  and  work  on  viewpoints 
[Attardi  1981;  Barber  1982;  Kornfeld  1982].  We  would  hke  to  incorporate 
some  of  these  ideas  in  our  next  version  of  Viewpoint  Management. 


Precedent  Management 

Precedent  Management  is  responsible  for  indexing  past  decisions  and  re- 
trieving ones  that  are  useful  for  the  current  decision  problem.  Once  they 
are  retrieved,  the  precedent  manager  extracts  from  them  the  pieces  of  the 
knowledge  that  are  relevant  for  the  present  problem  and  places  them  in  the 
present  decision  graph. 

SIBYL  uses  gocds  to  index  past  decisions.  Two  decision  problems  are 
judged  to  be  similar  and  potentially  useful  to  the  extent  that  they  share 
goals.  Using  goals  as  the  index  also  allows  the  system  to  determine  which 
parts  of  the  retrieved  decision  graph  are  actually  relevant.  It  is  those 
objects — the  claims  and  the  alternatives — that  are  linked  to  the  shared 
goals  and  their  subgoals.  We  can,  so  to  speak,  Uft  out  the  shared  goals  and 
the  subgoals  and  take  with  them  all  the  objects  that  are  linked  to  them. 
We  place  this  structure  in  the  current  decision  graph  by  overlaying  the 
shared  goals.  Figure  11  shows  a  new  decision  problem,  to  which  the  shzired 
goals  have  been  overlaid.  Using  precedents  this  way  is  also  useful  because 
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Figure  11.   The  example  decision  graph  augmented  by  knowledge  from  a  past 
dedaion. 
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it  allows  the  new  decision  maker  to  become  aware  of  other  alternatives  or 
of  different  ways  of  achieving  a  given  goal. 

The  following  problems  are  still  to  be  solved.  First,  some  of  the  goals 
and  claims  that  have  been  transferred  in  this  way  would  not  be  relevant 
after  all,  due  to  context  dependency.  What  is  represented  in  a  decision 
graph  usually  leaves  out  many  things  that  were  assumed  in  that  context. 
For  example,  the  claim,  "Eric  already  knows  the  language"  was  a  support- 
ing claim  for  the  claim  that  KEE  facilitates  minimize  development  time, 
because  in  that  context  Eric  was  the  person  who  waa  going  to  develop  the 
system.  This  fact  is  probably  not  true  any  more,  especially  if  it  is  a  differ- 
ent group  that  is  retrieving  this  decision  graph.  The  present  solution  is  to 
let  users  filter  out  irrelevant  facts  from  the  ones  that  the  system  suggests. 
We  will,  undoubtedly,  try  to  improve  the  algorithm  for  determining  the 
relevance  so  that  the  user  has  less  to  filter  out.  However,  we  do  not  think 
that  such  an  algorithm  can  entirely  eliminate  the  need  for  the  user  to  check 
the  result  without,  at  the  same  time,  requiring  her  to  supply  details  that 
would  otherwise  be  unnecessary. 

Another  problem  is  to  determine  which  goals  are  shared  across  decision 
problems.  Certainly,  matching  names  would  not  be  appropriate  as  names 
can  be  arbitrciry  strings.  A  solution  is  to  provide  a  taxonomy  of  goals,  from 
which  users  can  create  instances.  Then,  we  would  have  a  basis  for  judging 
the  similarity  among  goals.  We  have  partially  developed  such  a  taxonomy, 
but  more  work  needs  to  be  done.  Yet  ainother  problem  is  that  of  credit 
assignment.  One  would  not  want  to  make  a  decision  based  on  the  knowledge 
used  for  past  decisions  that  turned  out  to  be  disasters.  Nevertheless,  some 
pieces  of  the  knowledge  in  such  decisions  may  still  be  useful.  We  would 
like  to  associate  the  failure  or  the  success  of  a  decision  with  the  pieces  of 
knowledge  responsible  for  the  result.  The  present  solution  in  SIB>X  is  to 
represent  this  information  in  the  following  attributes  of  decision  problem 
object:  Outcome  and  Responsible-Objects.  This  way,  SEBYL  at  least  allows 
users  to  represent  and  examine  the  needed  information.  However,  at  the 
moment,  these  attributes  have  no  computational  significance.  We  want  to 
explore  ways  to  make  these  attributes  computationally  useful.  Obviously, 
there  is  room  here  for  applying  the  ideas  from  learning  and  case-based 
reasoning  research  [Michalski  ei  al.  1986;  Kolodner  1988;  Winston  1986]. 
It  would  be  a  challenge  to  incorporate  some  of  the  ideas  from  this  research 
into  Precedent  Management. 

Related  Work 

Studies  on  decision  making  abound.  There  are  quantitative  decision  theo- 
ries, psychological  studies  on  human  decision  making,  organizational  the- 
ories, political  decision  making,  decision  support  systems,  and  studies  on 
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qualitative  decision  making.  Many  of  these  studies  aie  relevant  to  the  work 
described  in  this  chapter.  For  example,  a  qualitative  decision  management 
system  like  SDBYL  can  be  viewed  as  complementing  classics]  maximum  ex- 
pected utility  theory.  In  the  classical  decision  theory,  only  the  alternatives 
and  possible  consequences  are  represented  explicitly;  goals  are  merged  into 
the  utility  function  and  the  arguments  disappear  into  the  probability  distri- 
bution over  the  consequences.  In  this  sense,  a  qualitative  decision  manage- 
ment system  provides  a  means  for  retrieving  amd,  when  necessary,  changing 
the  intuitions  behind  the  utility  and  probabihty  assignments.  However,  it 
should  be  clear  that  a  qualitative  decision  management  system  and  the 
classical  decision  theory  are  quite  different  in  both  their  goals  and  struc- 
tures. 

In  the  rest  of  this  section,  we  discuss  the  relation  of  SIBYL  to  various 
computational  studies  on  qualitative  decision  making  because  they  share 
the  goal  of  a  qualitative  decision  management  system;  namely  the  repre- 
sentation and  management  of  the  qualitative  aspects  of  decision  making 
processes.  This  category  includes  work  such  as  Toulmin's  [1%9]  theory  of 
arguments,  gIBIS  (Conkhn  L  Begeman  1988],  and  Etoyle's  [1980]  model  of 
deUberation.  We  include  Toulmin's  work,  though  it  is  not  computational, 
because  his  work  has  been  adopted  widely  as  a  model  of  argument  in  many 
computational  studies  [Birnbaum  et  al.  1980;  Lowe  1986]  as  well  as  in  other 
fields.  Below,  we  give  a  brief  comparison  of  these  studies  to  SIBYL. 

A  British  philosopher,  Stephen  Toulmin,  proposed  a  model  of  au'gu- 
ment  in  1969.  Figure  12  shows  Toulmin's  model  and  an  example.  A  Clatm 
is  the  main  assertion  being  made;  a  Datum  supports  the  claim;  a  Warrant 
is  the  basis  on  which  the  Datum  is  said  to  support  the  claim,  a  Backing, 
in  turn,  supports  the  Warrant;  a  Qua/i^er  qualifies  the  extent  to  which  the 
Datum  supports  the  claim,  and  a  Rebuttal g\\es  a  reason  for  the  Qualifier. 

We  decided  not  to  use  Toulmin's  model  for  representing  arguments  be- 
cause Toulmin's  object  types  do  not  support  the  uniformity  and  extendibil- 
ity  of  representation.  For  example,  Toulmin's  model  allows  a  Claim  to  be 
backed  up,  qualified,  or  rebutted  but  not  a  Datum  or  a  Warrant.  It  is  not 
clear  what  to  do  if  one  wajits  to  argue  about  the  validity  of  a  Datum  or 
disagrees  with  a  Warrant.  Also,  one  can  deny  an  existing  claim  only  in 
a  round-about  way  by  supporting  its  negation.  One  can  qualify  a  claim, 
but  it  is  not  clear  whether  that  qualification  is  due  to  some  uncertainty 
over  situations,  less  than  perfect  plausibility  of  data,  or  the  weak  relation 
between  data  and  claim. 

gIBIS  (graphical  Issue  Based  Information  System)  is  a  "hypertext  tool 
for  exploratory  policy  discussion"  that  is  being  developed  by  Conklin  and 
Begeman  [1988].  The  goal  of  gIBIS  is  to  capture  the  design  rationade;  the 
design  problems,  alternative  resolutions,  tradeoff  analysis  among  these  aJ- 
ternatives,  and  the  tentative  amd  firm  commitments  that  were  made  during 
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Figure  12.  (a)  Toulmin's  model  of  argument  and  (b)  an  example. 


the  decision  making  process.  gIBIS  is  similar  to  SIBYL  in  its  goal  and  also 
in  that  it  is  a  system  designed  to  support  human  decision  making. 

The  difference  between  SBYL  and  gIBIS  comes  from  the  structures 
provided  in  achieving  this  goal  and  the  types  of  services  they  provide  using 
these  structures  .  Figure  13  shows  the  ontology  of  gIBlS.  Issue  corresponds 
to  Decision  Problem  in  DRL,  Position  corresponds  to  Alternative,  and 
Argument  corresponds  to  Claim.  Notably  lacking  in  glBlS  is  the  explicit 
representation  of  Goal.  In  Lee  [1989a],  we  point  out  the  importance  of 
making  goals  explicit:  they  allow  modular  representation  of  arguments; 
they  force  users  to  articulate  evaluation  criteria;  they  let  users  argue  about 
them,  and  they  provide  a  basis  for  precedent  management  as  well  as  multi- 
ple viewpoints.  Another  general  difference  between  gIBIS  and  SIBYL  is  that 
gIBIS  is  maiinly  a  hypertext  system  whose  services  focus  on  the  presentation 
of  objects  in  such  a  way  that  it  is  easy  to  enter  arguments  and  easy  to  see 
the  structure  of  what  has  been  represented.  On  the  other  hand,  SIBYL  is 
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Figure  13.  (a)  The  gIBIS  model  of  argument  and  (b)  an  example. 


a  knowledge-based  system  whose  services  focus  on  the  management  of  the 
dependency   among  the  objects. 

Doyle  [1980]  proposed  "a  model  for  deliberation,  action,  and  intro- 
spection." It  is  worth  relating  the  model  underlying  SIBYL  to  his  model 
because  his  is  the  most  comprehensive  and  detailed  model  of  defeasible 
reasoning  that  we  have  seen  so  far,  that  is,  where  the  assertions  are  non- 
monotonic. As  Doyle  points  out,  this  provides  an  important  framework 
for  dialectical  reasoning,  that  is,  reasoning  based  on  arguments,  Doyle's 
theory  is  very  comprehensive  and  we  could  not  do  it  justice  here.  How- 
ever, Doyle's  work  is  described  in  Lee  [1989a].  Here,  we  note  that  the 
goal  of  Doyle's  model  is  to  control  or  direct  the  reasoning  and  actions  of 
a  computer  program  by  explicitly  representing  and  justifying  the  reasoning 
process  itself.  SIBYL  has  a  less  ambitious  goal  than  Doyle's.  SIBYL  provides 
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a  model  for  decision  maicing  sufficient  to  support  users  making  decisions. 
Furthermore,  the  scope  of  SIBYL  is  restricted  to  the  kind  of  decision  making 
which  involves  evaluating  well-defined  alternatives  against  a  set  of  goals. 
That  restriction  in  scope  lets  SIBYL  provide  teisk-specific  constructs  such 
a£  the  Facilitates  relations,  which  allows  more  modular  representation 
of  the  arguments  evaluating  alternatives,  as  well  as  allowing  one  to  argue 
about  such  relations. 

We  would  like  to  view  SIBYL  as  a  system  that  b  compatible  with 
Doyle's  model  but  is  non-committal  about  some  of  its  aspects.  Thus,  the 
model  underlying  DHL  is  not  as  explicit  as  Doyle's,  however,  it  does  not 
have  to  do  things  hke  making  assertions,  the  way  Doyle  prescribed.  What 
SIBYL  requires  is  that  claims  are  produced  and  linked  to  other  claims 
through  the  relations  that  DRL  provides.  The  claims  could  have  been 
produced  in  a  manner  consistent  with  Doyle's  model  or  otherwise.  Also, 
one  may  decide,  for  computational  tractability,  not  to  keep  justifications 
for  every  step  in  the  reasoning  process.  In  that  sense,  SIBYL  can  be  viewed 
as  a  higher  level  interface  to  something  like  Doyle's  model,  but  not  bound 
to  it. 

Future  Work 

We  mentioned  above  many  of  the  specific  problems  that  we  are  still  tack- 
ling. Here,  we  discuss  more  general  topics  of  future  research. 

Earlier  we  discussed  four  major  types  of  services — dependency,  plausi- 
bility, viewpoint,  and  precedent  management.  As  we  apply  SIBYL  to  more 
complex  decision  making  processes,  we  expect  to  identify  more  types  of 
services  that  prove  useful.  For  example,  the  importance  of  risk  manage- 
ment has  been  pointed  out  by  Boehm  [1988].  Risk  management  would  be 
responsible  for  identifying  the  significant  sources  of  risk,  evaluating  the  risk 
associated  with  each  alternative,  and  helping  users  to  allocate  the  resources 
based  on  the  evaluation.  Given  that  risk  is  the  uncertainty  of  achieving 
important  goals  and  that  uncertainty  is  represented  in  DRL  by  an  lallu- 
«nces  relation,  SIBYL  can  help  identify  risks  by  finding,  for  example,  the 
important  goals  whose  associated  Facilitates  relation  is  influenced  by  a 
Question,  directly  or  indirectly.  The  technique  used  to  resolve  the  risk  can 
also  be  represented  as  a  Procedure  and  linked  to  the  Question  through 
Is-ln-AnsBering-Procedure-For  so  that  the  knowledge  can  be  used  by 
others  later.  We  plan  to  explore  this  and  further  potential  types  of  services 
that  &K  useful  in  complex  decision  making. 

We  also  plan  to  study  the  process  of  qualitative  decision  management 
as  a  computationad  problem  solving  paradigm  based  on  arguments.  So  far, 
we  have  discussed  SIBYL  in  the  context  of  providing  support  for  human  de- 
cision making.  However,  the  importance  of  human-hke  decision  analysis — 
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in  the  sense  of  involving  arguments,  evaluating  alternatives,  com; —tmus- 
ing  and  negotiating — is  also  important  in  automated  reasoning.  Eewwut 
[1986],  for  example,  pointed  out  the  features  of  open  systems,  suci  is  ;  in- 
completeness and  inconsistency,  which  makes  a  purely  deductive  afcrrroach 
unrealistic.  What  happens  in  real  systems  and  what  needs  to  be  mrmaded 
in  artificial  systems  is  the  complexity  of  the  dialectical  processes  ifltci'v^ang 
the  interactions  among  agents  with  different  goals,  shtired  resourc«.  .  and 
different  expertise.  A  Qualitative  Decision  Management  System  is  in  ;  at- 
tempt to  identify  and  articulate  the  objects  and  the  processes  invaT?ed  in 
such  decision  making  processes.  As  such,  we  feel  that  there  is  no  r-sason 
why  the  same  language  and  the  same  services  could  not  be  used  n.  rnnak- 
ing  decisions  by  computational  agents,  provided  that  the  attribute  vaauues 
of  the  objects  are  themselves  computational  objects.  Doing  this  rwrruires 
much  more  work,  including  a  careful  analysis  of  the  relation  betweer  SIHB'^X 
and  those  in  other  systems  such  as  Doyle's. 
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